PATENT ABSTRACTS OF JAPAN 



(1 1 publication number : 08-1 26034 

(43)Date of publication of application : 17.05.1996 



(5 Dint CI. 




H04N 13/04 
G02B 27/22 
G03B 35/18 




(21 Application number 


: 06-281279 


(71)Applicant 


CANON INC 


(22)Date of filing : 


20.10.1994 


(72)Inventor : 


YANO KOTARO 








UJIMA KATSUMI 



(54) METHOD AND DEVICE FOR DISPLAYING STEREOSCOPIC IMAGE 

(57)Abstract: 

PURPOSE: To avoid a sense of incongruity by devising a 
method such that the size of an observed image is felt 
identically to be an actual size even when the interval of 
optical axes differs between image pickup and 
observation. 

CONSTITUTION: The display device is provided with a 
left image pickup system 1L and a right image pickup 
system 1 R whose optical axes are arranged in parallel at 
a prescibed interval 10, an image input section 2, image 
memories 3L t 3R t an image interpolation section 4, an 
image output section 6 and an HMD 7. One image is 
displayed through image interpolation from two images 
so that the parallax of the images in the case of HMD 
display is equal to a parallax &utri;1 when an object is 
actually viewed. Reference point extract processing is 
conducted by using left image data and right image data 
being inputs to an image interpolation section 4. A small 
area of the left image is segmented as a template moved 
in parallel to detect a position at which a total sum of 

differences from the right image data is least and the result is used for the pixel position of the 
corresponding right image. The distance information is expressed as 1/Z=(xL-xR)/(f.10)and the 
X-coordinate of an interpolation image is expressed as x=xL-f.1 1/Z based on the pixel positions 
xL, xR of the corresponding left and right images and the image pickup parameters. 
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JP,08-126034,A 
* NOTICES * 

Japan Patent Office is not responsible for anydamages caused by the use of this translation. 
5 l.This document has been translated by computer. So the translation may not reflect the 
original precisely. 

2 **** s hows the word which can not be translated. 
3. In the drawings, any words are not translated. 



10 CLAIMS 



[Claim(s)] 

[Claim 1] In the solid image display device which is equipped with a display means to 
display each image photoed with the camera of two right and left, and observes the image 

15 this displayed as a solid image with both eyes It is the solid image display device 

characterized by having had a generation means to generate at least one side of the image 
displayed on said display with the interpolation using the image of another side, and 
equipping this generation means with a interpolation means to interpolate based on view 
spacing at the time of image photography, and optical-axis spacing at the time of image 

20 display at least. 

[Claim 2] It has an amount detection means of gaps to detect the amount of gaps of the 
pixel location corresponding to each image photoed with the camera of said two right and 
left. Said interpolation means The solid image display device according to claim 1 
characterized by interpolating so that a ratio with the amount of gaps of the image 
25 displayed on the amount of gaps and said display of each of said detected pixel location 
may become equal to the ratio of view spacing at the time of image photography, and 
optical-axis spacing at the time of image display. 
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[Claim 3] It has an amount detection means of gaps to detect the amount of gaps of the 
pixel location corresponding to each image photoed with the camera of said two right and 
left. Said interpolation means The solid image display device according to claim 1 
characterized by interpolating so that a ratio with the amount of gaps of the image 
5 displayed on the amount of gaps and said display of each detected this pixel location may 
become equal the constant twice of the ratio of view spacing at the time of image 
photography, and optical-axis spacing at the time of image display. 

[Claim 4] Claim 1 which is equipped with the image transformation section from which an 
optical axis changes the image which attached congestion to the optical axis, set up said 
10 two cameras, and was photoed with two this set-up cameras into the image made parallel, 
and is characterized by said interpolation means interpolating said changed image thru/or 
claim 3 are the solid image display device of a publication either. 

[Claim 5] In the solid image display approach of displaying each image photoed with the 
camera of two right and left, and observing the image this displayed as a solid image with 
15 both eyes The solid image display approach characterized by interpolating it based on view 
spacing at the time of image photography, and optical-axis spacing at the time of image 
display at least in case the interpolation using the image of another side generates at least 
one side of the image displayed on said display. 

DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

25 [Industrial Application] This invention relates to the solid image display device which 

observes the image which has the parallax acquired by two or more image pick-up means 
as a solid image. 
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[0002] 

[Description of the Prior Art] What carries out stereoscopic vision using the shutter glasses 
which picturize the image corresponding to both eyes, switch them by turns, display them 
for every field of television, are synchronized with the image, and are opened and closed is 
5 known with the camera of two right and left as an indicating equipment which observes a 
solid image conventionally. However, if this indicating equipment is not observed near the 
core of television, it has the problem that a cubic effect is not acquired. 
[0003] In order to solve this, two displays for observing an image on either side 
independently by the eye of right and left of an observer are prepared in a head, and the 
10 technique of inputting the video signal of the camera of two right and left into the so-called 
HMD (Head Monted Display) by which the display was carried in this head directly, and 
observing a solid image is known. 
[0004] 

[Problem(s) to be Solved by the Invention] However, in the above-mentioned conventional 
15 example, when spacing of the optical axis of two cameras at the time of photography 

differed from spacing of the display of HMD, the problem that sense of incongruity arose 
was in a cubic effect. Although especially average spacing of human being's eye is about 
65mm and spacing of the display of HMD is also doubled with about 65mm, since it is 
restricted in the magnitude of a camera and the direction of spacing at the time of an image 
20 pick-up generally becomes larger than spacing at the time of observation, the so-called 

miniature garden effectiveness that an observation image also actually senses a twist small 
produces spacing of a camera. 

[0005] This invention aims at offering the solid image display device which can obtain a 
solid image without the sense of incongruity sensed equivalent to magnitude with the actual 
25 magnitude of the image observed when optical-axis spacing differs in the time of 
photography and observation. 
[0006] 
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[Means for Solving the Problem] In order to attain the above-mentioned purpose, the solid 
image display device concerning claim 1 of this invention In the solid image display device 
which is equipped with a display means to display each image photoed with the camera of 
two right and left, and observes the image this displayed as a solid image with both eyes It 
5 has a generation means to generate at least one side of the image displayed on said display 
with the interpolation using the image of another side, and this generation means is 
equipped with a interpolation means to interpolate based on view spacing at the time of 
image photography, and optical-axis spacing at the time of image display at least. 
[0007] The solid image display device concerning claim 2 is equipped with an amount 

10 detection means of gaps to detect the amount of gaps of the pixel location corresponding to 
each image photoed with the camera of said two right and left in the solid image display 
device concerning claim 1 . Said interpolation means is interpolated so that a ratio with the 
amount of gaps of the image displayed on the amount of gaps and said display of each of 
said detected pixel location may become equal to the ratio of view spacing at the time of 

15 image photography, and optical-axis spacing at the time of image display. 

[0008] The solid image display device concerning claim 3 is equipped with an amount 
detection means of gaps to detect the amount of gaps of the pixel location corresponding to 
each image photoed with the camera of said two right and left in the solid image display 
device concerning claim 1. Said interpolation means is interpolated so that a ratio with the 

20 amount of gaps of the image displayed on the amount of gaps and said display of each this 
detected pixel location may become equal the constant twice of the ratio of view spacing at 
the time of image photography, and optical-axis spacing at the time of image display. 
[0009] The solid image display device concerning claim 4 attaches congestion to an optical 
axis in the solid image display device concerning either claim 1 thru/or claim 3, and sets up 

25 said two cameras, it has the image transformation section from which an optical axis 

changes the image photoed with two this set-up cameras into the image made parallel, and 
said interpolation means interpolates said changed image. 
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[0010] In the solid image display approach of the solid image display approach concerning 
claim 5 displaying each image photoed with the camera of two right and left, and observing 
the image this displayed as a solid image with both eyes In case the interpolation using the 
image of another side generates at least one side of the image displayed on said display, it 
5 is interpolated based on view spacing at the time of image photography, and optical-axis 
spacing at the time of image display at least. 
[0011] 

[Function] In the solid image display device concerning claim 1 of this invention Each 
image photoed with the camera of two right and left with the display means is displayed. In 
10 case the this image displayed is observed as a solid image with both eyes, the interpolation 
using the image of another side generates at least one side of the image displayed on said 
display by the generation means, and it is interpolated based on view spacing at the time of 
image photography, and optical-axis spacing at the time of image display at least with a 
interpolation means. 

15 [0012] The amount of the pixel location corresponding to each image which photoed with 
the camera of said two right and left with the amount detection means of gaps of gaps 
detects, and in the solid image display device concerning claim 2, said interpolation means 
interpolates so that a ratio with the amount of gaps of the image displayed on the amount of 
gaps and said display of each of said detected pixel location may become equal to the ratio 

20 of view spacing at the time of image photography, and optical-axis spacing at the time of 
image display. 

[0013] The solid image display device concerning claim 3 detects the amount of the pixel 
location corresponding to each image which photoed with the camera of said two right and 
left with the amount detection means of gaps of gaps, and said interpolation means 
25 interpolates so that a ratio with the amount of the image displayed on the amount of gaps 

and said display of each this detected pixel location of gaps may become equal the constant 
twice of the ratio of view spacing at the time of image photography, and optical-axis 
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spacing at the time of image display. 

[0014] The solid image display device concerning claim 4 changes the image photoed with 
two cameras which attached congestion to the optical axis, set up said two cameras, and 
were this set up by the image transformation section into the image made parallel [ an 
5 optical axis ], and said interpolation means interpolates said changed image. 
[0015] 

[Example] The example of the solid image display device of this invention is explained. 
[0016] [1st example] drawing 1 is the block diagram showing the configuration of the solid 
image display device of the 1st example. In drawing, 1L and 1R are a left image pick-up 
10 system and a right image pick-up system, respectively, only the predetermined spacing 10 is 
left and an optical axis is arranged in parallel. 

[0017] The image input section 2 changes into digital image data the video signal outputted 
from the camera of left image pick-up system 1L and right image pick-up system 1R for 
every frame, and memorizes it in the image memory 3L and 3R, respectively. The image 

15 interpolation section 4 interpolates the image displayed on the right display of HMD7 from 
the image data memorized in image memories 3L and 3R, and outputs image data to the 
image memory 5 for an output. The image output section 6 changes into a video signal the 
digital image data memorized in the image memory 5 for image memory 3L and an output, 
respectively, and outputs them to HMD7. 

20 [001 8] Drawing 2 is the explanatory view showing the principle of the method of 

presentation of a solid image. In drawing, in X, a horizontal direction and Y (not shown) 
express perpendicularly and Z expresses the depth direction. IL and IR are the image 
surfaces of a left image pick-up system and a right image pick-up system, respectively, and 
are in the location of a focal distance f from a view, respectively, and spacing during a view 

25 is 10. Since parallax is produced only in the direction of X at this time, only X coordinate is 
explained below. The Y coordinate of the same point is eternal about a right-and-left image 
and the interpolation image to display. 
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[0019] O is the object point on a photographic subject, and only distance Z has separated it 
from the view of both cameras. xL and xR are the image points on each image surface IL 
and IR of the object point O, and are shown by the formula (1). 
[0020] 
5 [Equation 1] 

Parallax **0 is shown by the formula (2) when it picturizes with xL=f-X/Z, xR=f-(X-10)/Z, 

therefore the camera that left only 10. 

[0021] 

[Equation 2] **0=xL-xR=f-10/Z — when the image picturized on such conditions on the 
10 other hand is observed by HMD of the optical-axis spacing 1 1 , parallax ** 1 when actually 
observing a photographic subject is similarly shown by the formula (3). 
[0022] 

[Equation 3] **l=f-ll/Z, therefore the image with which the parallax also with a big twist 
arose will be observed, and the distance of the depth direction is actually sensed small. 

15 [0023] It is made to display in this example with the image interpolation which asked for 
the image from two images so that while might be set to parallax **1 when the parallax of 
the image at the time of a HMD display actually observes a photographic subject. 
[0024] Drawing 3 is the explanatory view showing an example of image interpolation. In 
drawing, a and c are a left image and a right image, respectively, and are the interpolation 

20 image with which b performed the parallax correction. 

[0025] Drawing 4 is a flow chart which shows image interpolation processing. First, 
corresponding-points extract processing is performed using the left image data and right 
image data which are the input of the image interpolation section 4 (step S401). 
Corresponding-points extract processing is processing which asks for the pixel location of 

25 the right image corresponding to all the pixels of a left image, and is performed by [ as 
being the following ]. 

[0026] First, the small field of a left image is started as a template, parallel translation is 
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carried out to a template, applying location offset, and total of a difference with right image 
data detects the smallest location, and makes it the pixel location of a corresponding right 
image. When the difference of a template and image data does not become below a fixed 
threshold, or when two or more locations with the minimum value of a difference exist and 
5 corresponding points cannot be specified, the flag which tells that corresponding points are 
not found is built. The pixel location of the detected right image is converted and outputted 
to the image surface coordinate of right image pick-up system 1R. 
[0027] Calculation of distance is performed from the pixel location of the left image 
corresponding to the next, and a right image, and an image pick-up parameter (step S402). 
10 From the coordinates xL and xR of the pixel location of a corresponding left image and a 
right image, with a formula (1), it can be found as distance information is a formula (4). 
[0028] 

[Equation 4] l/Z=(xL-xR)/(f-10) 

Moreover, the x-coordinate in the interpolation image displayed at this time can be found 
15 from a formula (5). 
[0029] 

[Equation 5] All the distance information that is the pixels in which corresponding points 
are found within x=xL-f-ll/Z, thus the interpolation image displayed by processing of step 
S402 can be found. However, since distance information cannot be found in the field which 
20 cannot take correspondence of a pixel location by the left image and the right image, 
distance interpolation processing is performed (step S403). 

[0030] Drawing 5 is the explanatory view showing the contents of distance interpolation 
processing. In drawing, since the field shown with a slash was hidden by the short-distance 
body, it is a field which was not able to take correspondence with a right-and-left image. 
25 Among these, the field shown by OL is located on the left-hand side of a short-distance 

body, the distance information on right and left of this field is compared, when the direction 
of a right-hand side field is a long distance, it is recognized, and distance is interpolated 
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from the distance information on a right-hand side field. By the above processing, all the 
distance information in the interpolation image to display can be found. 
[0031] From the distance information and the image pick-up parameter which were able to 
be found at step S403, it asks by the coordinate transformation equation showing the pixel 
5 coordinate of the left image of all the pixels on a interpolation image, and a right image to a 
formula (6). 
[0032] 
[Equation 6] 

Image data-interpolation processing is performed from the pixel coordinate of a 
10 right-and-left image and right-and-left image data which were able to be found at 

xL=x+f-ll/Z, and the xR=xL-f-10 / Z step S404 (step S405). Interpolation of image data is 
performed by processing of hyperbolic form interpolation etc. As for the field where the 
field where corresponding points were able to be found, and the field shown by OL of 
drawing 5 show the interpolation value from a left image by OR, the interpolation value 
15 from a right image is given at this time. The interpolation image data displayed by step 
S405 is outputted to the image memory 5 for an output. 

[0033] Therefore, the solid image which is filling the formula (2) with the above-mentioned 
relation of parallax **1 when actually observing a photographic subject with parallax **0 
picturized with the camera on either side in this example and (3), and does not have the 
20 sense of incongruity sensed equivalent to magnitude with the magnitude of the image 
observed actual since it is **0:** 1=10:11 can be obtained. 

[0034] The [2nd example] Below, the solid image display device of the 2nd example is 
explained. In said 1st example, since the photographic subject image which was common 
with the right-and-left image will no longer be obtained if optical-axis spacing of the image 
25 pick-up systems 1L and 1R becomes to some extent large, it is not parallel in the optical 

axis of the right-and-left image pick-up systems 1L and 1R, and it is necessary to attach and 
set up congestion to some extent. 
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[0035] In the 2nd example, interpolation of the display image to such a case and generation 
are performed. Drawing 6 is the block diagram showing the configuration of the solid 
image display device of the 2nd example. 1L and 1R are a left image pick-up system and a 
right image pick-up system, respectively, and an optical axis leaves only the predetermined 
5 spacing 12, each optical axis crosses by angle-of-convergence 2theta, and they are arranged. 
[0036] The image input section 2 changes into digital image data the video signal outputted 
from the camera of left image pick-up system 1L and right image pick-up system 1R for 
every frame. The image transformation sections 8L and 8R are changed into the image data 
which made parallel the optical axis of the right-and-left image pick-up systems 1L and 1R, 

10 and picturized it from the image data of each right and left changed into digital image data, 
and are memorized in the image memory 3L and 3R, respectively. The image interpolation 
section 10 generates with interpolation the image displayed on the right display of HMD7 
from the image data memorized in image memories 3L and 3R, and outputs image data to 
the image memories 9L and 9R for an output. The image output section 6 changes into a 

15 video signal the digital image data memorized in the image memories 9L and 9R for an 
output, respectively, and outputs them to HMD7. 

[0037] Drawing 7 is the explanatory view showing the contents of processing of the image 
transformation sections 8L and 8R. In drawing, the image surface of a left image pick-up 
system and a right image pick-up system where IL and IR carried out congestion only of 

20 theta to the photographic subject, respectively, IL', and IR' are the image surfaces of the left 
image pick-up system at the time of making an optical axis parallel, and a right image 
pick-up system, image transformation — the section — eight — L — **** — the object point 
— O — receiving — the left — an image pick-up — a system — the image surface — IL — the 
image point — xL — an optical axis — parallel — having carried out — a case — the left — an 

25 image pick-up — a system — the image surface — IL — ' — the image point — xL — ' — 
corresponding — as — an image — changing . 

[0038] Since the correspondence relation of xL and xL f does not have view migration, the 

10 
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parameter of angle-of-convergence 2theta is carried out to a focal distance f 3 and it is 
matched. Similarly, in image transformation section 8R ? an image is changed so that it may 
correspond to the image point of image surface IR' of a right image pick-up system when 
the image point of the image surface IR of a right image pick-up system makes an optical 
5 axis parallel. 

[0039] Drawing 8 is the explanatory view showing the example of image transformation. 
The keystone distortion has produced a and b for congestion by the input image from a left 
image pick-up system and a right image pick-up system, respectively, c and d are an image 
at the time of making an optical axis parallel by the output image from the image 

10 transformation section. However, the shadow area of drawing is a field where image data is 
not inputted, and the optical-axis core has shifted in the direction of X, respectively. 
[0040] Drawing 9 is the explanatory view showing the contents of processing of the image 
interpolation section 10. IL' and IR' are the image surfaces of the left image pick-up system 
at the time of making an optical axis parallel, and a right image pick-up system, 

15 respectively, and the image with which parallax produced only the part of the optical-axis 
spacing 12 is inputted from image memories 3L and 3R. The display image which 
optical-axis spacing is 11 and outputs the image which should be displayed on HMD7 to 
image memory 9L for an output is an image which is set to parallax **2 shown in a 
formula (7) to the image of image memory 3L, and interpolates and generates this from 

20 right-and-left image data and an image pick-up parameter in the image interpolation section 
10. 

[0041] 

[Equation 7] **2=f-(12-ll)/(2Z) 

Similarly, the display image outputted to image memory 9R for an output is an image 
25 which is set to parallax **3 shown in a formula (8) to the image of image memory 3L, and 
interpolates and generates this from right-and-left image data and an image pick-up 
parameter in the image interpolation section 10. 

11 
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[0042] 

[Equation 8] **3=f-(12+ll)/(2Z) 

The approach of image interpolation performs processing equivalent to said 1st example 
shown in drawing 4 , and generates two interpolation images. 
5 [0043] As shown above, when it observes by HMD also to the picturized image which 
carried out congestion, with the solid image display device of the 2nd example, a solid 
image without sense of incongruity can be obtained. 

[0044] The [3rd example] Below, the solid image display device of the 3rd example is 
explained. When picturizing a solid image, the miniature model of an actual photographic 

10 subject may be picturized and displayed. In this case, it can be made to display that a twist 
also actually senses an observation image large using image interpolation processing. 
[0045] The solid image display device of the 3rd example has the same configuration as 
said 2nd example. Drawing 10 is the explanatory view showing the contents of processing 
in the image interpolation section 10 for showing the image of the picturized miniature 

15 model greatly. 

[0046] Like drawing 9 , 1L 1 and IR' are the image surfaces of the left image pick-up system 
at the time of making an optical axis parallel, and a right image pick-up system, 
respectively, and the image with which parallax produced only the part of the optical-axis 
spacing 12 is inputted from image memories 3L and 3R. Although optical-axis spacing is 11, 

20 the image which should be displayed on HMD as 13=ll/beta, since parallax should just be 
set to 1/beta to show the picturized image actual beta twice The display image outputted to 
image memory 9L for an output is an image which is set to parallax **4 as shown in a 
formula (9) to the image of image memory 3L, and interpolates and generates this from 
right-and-left image data and an image pick-up parameter in the image interpolation section 

25 10. 

[0047] 

[Equation 9] **4=f-(12-13)/(2Z) 

12 
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Similarly, the display image outputted to image memory 9R for an output is an image 
which is set to parallax **5 as shown in a formula (10) to the image of image memory 3L, 
and interpolates and generates this from right-and-left image data and an image pick-up 
parameter in the image interpolation section 1 0. 
5 [0048] 

[Equation 10] **5=f-(12+13)/(2Z) 

As shown above, when it observes by HMD to the image which picturized the miniature 
model of an actual photographic subject, by this example, the solid image sensed for the 
magnitude of the scale factor of a request of the magnitude of a miniature model can be 
10 obtained. 

[0049] In addition, it cannot be overemphasized that equivalent effectiveness is acquired 
also about the case where stereoscopic vision is carried out using the shutter glasses which 
switch two picturized images by turns, display them for every field of television, are 
synchronized with the image, and are opened and closed although it was the case where it 
15 was made to display on HMD, in the example shown above. 
[0050] 

[Effect of the Invention] According to the solid image display device concerning claim I of 
this invention, each image photoed with the camera of two right and left with the display 
means is displayed. In case the this image displayed is observed as a solid image with both 

20 eyes, at least one side of the image displayed on said display by the generation means Since 
the interpolation using the image of another side generates and it interpolates based on view 
spacing at the time of image photography, and optical-axis spacing at the time of image 
display at least with a interpolation means A solid image without the sense of incongruity 
sensed equivalent to magnitude with the actual magnitude of the image observed when 

25 optical-axis spacing differs in the time of photography and observation can be obtained. 

[0051] According to the solid image display device concerning claim 2, the amount of gaps 
of the pixel location corresponding to each image photoed with the camera of said two right 

13 
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and left with the amount detection means of gaps is detected. Since said interpolation 
means is interpolated so that a ratio with the amount of gaps of the image displayed on the 
amount of gaps and said display of each of said detected pixel location may become equal 
to the ratio of view spacing at the time of image photography, and optical-axis spacing at 
5 the time of image display A solid image without the sense of incongruity sensed equivalent 
to magnitude with the actual magnitude of the image observed can be obtained. 
[0052] According to the solid image display device concerning claim 3, the amount of gaps 
of the pixel location corresponding to each image photoed with the camera of said two right 
and left with the amount detection means of gaps is detected. Since said interpolation 

10 means is interpolated so that a ratio with the amount of gaps of the image displayed on the 
amount of gaps and said display of each this detected pixel location may become equal the 
constant twice of the ratio of view spacing at the time of image photography, and 
optical-axis spacing at the time of image display As opposed to the image which picturized 
the miniature model of an actual photographic subject, when it observes by HMD, the solid 

15 image sensed for the magnitude of the scale factor of a request of the magnitude of a 
miniature model can be obtained. 

[0053] According to the solid image display device concerning claim 4, attach congestion 
to an optical axis and said two cameras are set up. Since an optical axis changes the image 
photoed with two cameras this set up by the image transformation section into the image 
20 made parallel and said interpolation means interpolates said changed image Also to the 

picturized image which carried out congestion, when it observes, for example by HMD, a 
solid image without sense of incongruity can be obtained. 

[0054] In the solid image display approach of according to the solid image display 
approach concerning claim 5 displaying each image photoed with the camera of two right 
25 and left, and observing the image this displayed as a solid image with both eyes Since it is 
interpolated based on view spacing at the time of image photography, and optical-axis 
spacing at the time of image display at least in case the interpolation using the image of 
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another side generates at least one side of the image displayed on said display A solid 
image without the sense of incongruity sensed equivalent to magnitude with the actual 
magnitude of the image observed when optical-axis spacing differs in the time of 
photography and observation can be obtained. 

5 

DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram showing the configuration of the solid image display 
10 device of the 1st example. 

[Drawing 2] It is the explanatory view showing the principle of the method of presentation 
of a solid image. 

[Drawing 3] It is the explanatory view showing an example of image interpolation. 
[Drawing 4] It is the flow chart which shows image interpolation processing. 
15 [Drawing 5] It is the explanatory view showing the contents of distance interpolation 
processing. 

[Drawing 6] It is the block diagram showing the configuration of the solid image display 
device of the 2nd example. 

[Drawing 7] It is the explanatory view showing the contents of processing of the image 
20 transformation sections 8L and 8R. 

[Drawing 8] It is the explanatory view showing the example of image transformation. 
[Drawing 9] It is the explanatory view showing the contents of processing of the image 
interpolation section 10. 

[Drawing 10] It is the explanatory view showing the contents of processing in the image 
25 interpolation section 10 for showing the image of the picturized miniature model greatly. 
[Description of Notations] 
1L — Left image pick-up system 
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1R — Right image pick-up system 
2 — Image Input Section 
4 — Image Interpolation Section 
7 HMD 

8L 5 8R ~ Image transformation section 



[Translation done.] 
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